Papers with entity-driven answer set expansion
Return of EM: Entity-driven Answer Set Expansion for QA Evaluation (2025.coling-main)
Copied to clipboard
| Challenge: | Recent studies show that using large language models (LLMs) is the most reliable method to evaluate QA models, but suffers from limited interpretability, high cost, and environmental harm. |
| Approach: | They propose to use soft exact match (EM) with entity-driven answer set expansion to expand gold answer set to include diverse surface forms. |
| Outcome: | The proposed method outperforms traditional evaluation methods while offering the benefits of high interpretability and reduced environmental harm. |